THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present Invention relates to a three-dimensional 
Image capturing device by which a three-dimensional shape 
of a measurement subject, which Is to be measured, Is captured 
by a tlme-of -flight measurement. 

2 . Description of the Related Art 

To perform a three-dimensional Image processing for 
a three-dimensional Image comprised of an Image data and 
three-dimensional data of a measurement subject, such data 
being obtained by an Image Information sensing operation and 
a distance Information sensing operation of a 
three-dimensional Image capturing device, a high Image 
processing ability and a large storage capacity are required 
for the three-dimensional Image capturing device. However, 
as the three-dimensional Image capturing device Is 
miniaturized. It Is quite difficult to provide additional 
electric circuits and devices so as to obtain the above 
capability. Therefore, a conventional three-dimensional 
Image capturing device Is generally connected to a computer 
system, which Is externally disposed, by an Interface cable, 
for example, and detected data Is transmitted via the cable, 
so that the three-dimensional Image processing may be executed 



for the da-ba. 

In order to obtain a three-dimensional image of the 
whole or arbitrary part of a measurement subject, a data 
composing operation to compose si plurality of image data and 
5 three-dimensional data, which is obtained by the sensing 
operations from various directions, is necessary. However, 
if the three-dimensional image capturing device is connected 
to the computer with the cable, a range of locations, in which 
the three-dimensional image capturing device can be operated, 
n|o is limited, so that the sensing operations from various 

in 

fU directions are difficult. Further, the cable also becomes 

SO 

rU an obstacle to the sensing operation and encumbers the handling 

SO 

^ of the device . 

H SUMMARY OF THE INVENTION 

'Jzl5 An object of the present invention is to provide a 

iZ miniaturized light weight handy three-dimensional image 

capturing device by which data can be efficiently transmitted 
to a device externally provided, such as a computer system, without 
connecting any type of cable between the devices . 
20 According to the present invention, there is provided 

a three-dimensional image capturing device, comprising a 
first and second light source, an image device and a distance 
information sensing processor. 

The first and second light source radiates a light 
25 beam and the image device accumulates signal charge 
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corresponding to a quantity of light received on the image 
device . The distance information sensing processor radiates 
a distance measuring light beam from the first light source 
to a measurement subject and detects distance information 
that relates to the measurement subject by receiving a 
reflected light beam from the measurement subject due to the 
distance measuring light beam on the image device. The data 
transmitting processor controls radiation at the second light 
source and radiates transmitting light beams, so that data 
is transmitted to an external device through space. 

Preferably, the second light source is identical to 
the first light source . The pulse frequency-modulation bands 
of the distance measuring light beam and the transmitting 
light beam are different from each other, and the data 
comprises said distance information. Further, the device 
comprises an image sensing processor that detects image 
information of the measurement subject by forming an image 
of the measurement subject on the image device and the data 
comprises the image information. Furthermore, it may 

comprise a switching processor that switches on and off the 
drive of said transmitting processor. 

Preferably, a series of the distance measuring light 
beams and a series of the transmitting light beams are further 
superposed. In this case, the distance information sensing 
processor may radiate the distance measuring light beams from 



the first light source a predetermined number of times, so 
that signal charge is accumulated in the image device for 
each reiterated radiation- The timing for radiating the 
transmitting light beams is based upon the timing of the 
reiterated radiation of the distance measuring light beams. 

In a preferable example, the series of the distance 
measuring light beams and the series of the transmitting light 
beams are superposed, so that the transmitting light beams 
are radiated in the intervals between the distance measuring 
light beams , and the transmitting light beams comprise a pulse 
beam that represents binary data in predetermined digits . 
Further, the distance measuring light beams and the 
transmitting light beams are superposed by pulse-width 
modulation of the light beams , so that the light beams comprise 
two types of pulse beams having different widths, which 
represent the binary data and are concurrently used for 
detecting the distance information. Furthermore, the 
distance measuring light beams may comprise a synchronizing 
signal of an optical transmission system. 

In another preferable example of the present invention , 
an accumulation of the signal charge in the image device is 
synchronously carried out with the transmitting light beam, 
so that that transmitting light beam can be used as the distance 
measuring light beam as well, and by this, the transmitting 
light beams and the distance measuring light beams are 



superposed with each other. The data sequence transmitted 
by the transmitting light beams may comprise a partition signal 
that delimits the data sequence by predetermined binary digits 
of the data. 

5 The Image device preferably comprises a plurality of 

photoelectric conversion elements that accumulates signal 
charge corresponding to a quantity of light received, and 
signal charge holding units disposed adjacent to each of the 
photoelectric conversion elements . The accumulation of the 
OLO signal charge In the Image device begins with a fall of an 
electric charge discharging signal that discharges the charge 

lit accumulated In the photoelectric conversion elements, and 

EO 

\J\ ends with a fall of an electric charge transfer signal that 

fj transfers the signal charge accumulated In the photoelectric 

puis conversion elements to the signal charge holding units , The 

GO 

p electric charge transfer signal rises approximately 

simultaneously with the fall of the electric charge 
discharging signal . 

Further, the electric charge transfer signal may be 

20 generated by conjunction of a standard electric charge 
transfer signal comprised of periodic pulse signals and a 
data synchronizing pulse signal generated synchronously with 
the fall of a pulse signal of the data sequence. Also, the 
electric charge discharging signal may be generated by 

25 conjunction of the data synchronizing pulse signal and a 
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standard electric charge discharging signal , a period of which 
is the same as the standard electric charge transfer signal 
and from which the phase is delayed by a half period. The 
data synchronizing pulse signal may also be synchronized with 
5 the standard electric charge discharging signal and the pulse 
width of the data synchronizing pulse signal is the same as 
one period of the standard electric charge transfer signal. 
Furthermore, there is a distance measuring period, 
in which the distance measuring light beams are repeatedly 

£3L0 radiated the predetermined number of times , and it may comprise 
a data transmitting period and a supplement light emitting 

JrJ period. In the data transmitting period, the distance 

measuring light beams and the transmitting light beams are 
superposed and radiated . On the other hand , in the supplement 

ids light emitting period, the distance measuring light beams 

rn 

Q are radiated so as to supplement the number of the distance 

measuring light beams radiated in the data transmitting period, 
by the number deficient from the predetermined number of times . 

Further, according to the present invention, there 

20 is also provided a receiver for use in an optical transmission 
system, a transmitter of which comprises a three-dimensional 
image capturing device, comprising a first and second light 
source, an image device that accumulates signal charge, a 
distance information sensing processor and a data 

25 transmitting processor. 
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The first and second light source radiates a light 
beam and the image device accumulates signal charge 
corresponding to a quantity of light received on the image 
device . The distance information sensing processor radiates 
5 a distance measuring light beam from the first light source 
to a measurement subject and detects distance information 
which relates to the measurement subject by receiving a 
reflected light beam from the measurement subject due to the 
distance measuring light beam on the image device. The data 
^4-0 transmitting processor controls radiation at the second 
light source and radiates transmitting light beams, so that 
data is transmitted to the receiver of an external device 
J through space. The external device starts a receiving 

operation of the data when the receiver receives the distance 
PUS measuring light beam. 

53 BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention 
will be better understood from the following description, 
with reference to the accompanying drawings in which: 
20 Fig. 1 is a perspective view showing a camera provided 

with a three-dimensional image capturing device of a first 
embodiment of the present inventions- 
Fig. 2 is a block diagram showing an electrical 
construction of the camera of the first embodiment; 
25 Fig. 3 illustrates an arrangement of the camera, the 
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measurement subject and the computer system, when the data 
transmitting operation Is executed; 

Fig. 4 Is a view showing a principle behind a distance 
measurement ; 

Fig . 5 Is a timing chart showing a distance measurement 
light beam, a reflected light beam, a gate pulse and a 
distribution of an amount of a light beam received by a CCD ; 

Fig. 6 Is a plan view showing a disposition of 
photo-diodes and a vertical transfer unit, which are provided 
In the CCD of the first embodiment ; 

Fig. 7 Is a sectioned elevatlonal view of the CCD ; 

Fig. 8 Is a timing chart of a distance Information 
sensing operation by which data, corresponding to a distance 
from a camera body to each point on a surface of the measurement 
subject. Is sensed In the first embodiment; 

Fig. 9 Is a timing chart of a distance correction 
Information sensing operation In the first embodiment; 

Fig. 10 Is a timing chart of a reflectance Information 
sensing operation In the first embodiment; 

Fig. 11 Is a timing chart of a reflectance correction 
Information sensing operation In the first embodiment; 

Figs . 12 shows the first part of a flowchart of the 
distance Information sensing operation of the first 
embodiment ; 

Figs . 13 shows the second part of a flowchart of the 
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dls'tance information sensing operation of the first 
embodiment ; 

Fig. 14 shows the third part of a flowchart of the 
distance information sensing operation of the first 
5 embodiment ; 

Fig. 15 shows a flowchart of the receiving operation 
in the optical transmission system of the first embodiment; 

Fig . 16 is a perspective view showing a camera provided 
with a three-dimensional image capturing device of the second, 
^0 third and fourth embodiment of the present invention ; 
yn Fig. 17 is a block diagram showing an electrical 

^ construction of the camera in the second and third embodiment; 

Figs . 18 shows a flowchart of the distance information 
It.^ sensing operation of the second, third and fourth embodiment; 

^5 Fig. 19A shows a sequence of the pulse beam emission 

R with no data transmitting operation in the second embodiment; 

Fig. 19B shows a sequence of the pulse beam emission 
with the data transmitting operation of the second embodiment ; 

Fig. 20 is a flow chart of the data superposing 
20 operation in the second and third embodiment ; 

Fig. 21 is a flow chart of the receiving operation 
executed in the external computer system of the second and 
third embodiment; 

Fig. 22 shows a sequence of the pulse beam emission 
25 with the data transmitting operation of the third embodiment; 
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Fig. 23 is a block diagrsun showing an electrical 
construction of the camera in the fourth embodiment; 

Fig. 24 is a timing chart of a distance information 
sensing operation by which data^ corresponding to a distance 
5 from a camera body to each point on a surface of the measurement 
subject, is sensed in the fourth embodiment; 

Fig. 25 is a flow chart of the data superposing 
operation in the fourth embodiment; 

Fig. 2 6 shows the detail of the CCD driving pulse 

Q 

10 converter and the blocks that relate to the data superposxng 

on 

py operation in the block diagram shown in Fig. 23; 

m Fig. 27 is the sequence of the pulse signals output 

EO 

^ from the blocks shown in Fig. 26, during the data transmitting 

period; 

^ 15 Fig. 28 shows the sequence of the data transmitting 

5 period and the supplement light emitting period, which 

comprise the distance measuring period of the distance 
information sensing operation executed in the fourth 
embodiment ; 

20 Fig, 2 9 is the sequence of the pulse signals output 

from the blocks shown in Fig. 26, during the supplement light 
emitting period; 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is described below with 
25 reference to embodiments shown in the drawings. 
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Fig, 1 is an external view of a camera type optical 
reader (three-dimensional image capturing device) of a first 
embodiment of the present invention. 

On a front surface of a camera body 10, a view-finder 
5 window 12 is provided toward a left-upper edge, adjacent to 
a photographing lens 11 , and an electronic flash 13 is disposed 
toward a right-upper edge . On an upper surface of the camera 
body 10, a light emitting device (i.e. , a light source) 14, 
which radiates a laser beam (an infrared laser beam, for 
35 10 example, being a distance measuring light beaun) is mounted 

in 

ry above the photographing lens 11. A release switch 15, a data 

FU transmitting mode button 24 and a liquid crystal display panel 

Ey 

16 are provided on a left side of the light emitting device 
14, and a mode change dial 17 and a V/D mode switch 18 are 
15 provided on a right side of the device 14. On a side surface 
of the camera body 10, a card slot 19 is formed, into which 
a recording medium, such as an IC memory card, is insertable, 
and a video output terminal 20 and an interface connector 
21 are also provided. 
20 Fig. 2 is a block diagram showing an electrical 

construction of the camera of Fig. 1. 

An aperture 25 is provided in the photographing lens 11 . The 
opening degree of the aperture 25 is adjusted by an iris drive 
circuit 2 6. A focusing operation and a zoom operation of 
25 the photographing lens 11 are controlled by a lens drive 
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circuit 2 7 . 

An imaging device (CCD) 28 is disposed on an optical 
axis of the photographing lens 11. A subject image is formed 
on a light receiving surface of the CCD 28 through the 
5 photographing lens 11, and an electric charge corresponding 
to the subject image is generated therein. An operation, 
such as an accumulating operation and a reading operation 
of the electric charge of the CCD 28, is controlled by a CCD 
drive circuit 30. An electric charge signal, i.e. , an image 

a 

yg 10 signal, read from the CCD 28 is amplified by an amplifier 
pU 31, and is converted from an analog signal to a digital signal 

lU by an A/D converter 32 . The digital image signal is subjected 

'^'^ to a process, such as a gamma correction, in the image signal 

3t 

J^; process circuit 33, and is stored as digital image data in 

'Ji 15 an image memory 34. The iris drive circuit 26, the lens drive 
circuit 27, the CCD drive circuit 30 and the image signal 
process circuit 33 are controlled by a system control circuit 
35 , 

The digital image data are read from the image memory 
20 34, and supplied to an LCD drive circuit 36, which is operated 
in accordance with the digital image data, so that an image 
corresponding to the digital image data is indicated on an 
image indication LCD panel 37 . 

The digital image data read from the image memory 34 
25 are also transmitted to a TV signal encoder 38, so that the 
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digital image data can be transmitted to a peripheral monitor 
device (not shown) , provided externally to the camera body 
10 , through a video output terminal (not shown) , if necessary . 
The system control circuit 35 is connected to an interface 
circuit 40, which in turn is connected to an interface 
connector 21. Therefore, if there is a need, the digital 
image data read from the image memory 3 4 can also be transmitted 
to a computer (not shown) connected to the interface connector 
21 by an interface cable . Further , the system control circuit 
35 is connected to an image recording device 43 through a 
recording medium control circuit 42 . Therefore , the digital 
image data read from the image memory 34 can be recorded in 
a recording medium M, such as an IC memory card, mounted in 
the image recording device 43. Note that the camera need 
not be connected to the computer with the interface cable. 
Namely, the image data can also be transmitted by the optical 
transmitting system described later. Further, the video 
output terminal is not essential. 

A light emitting element control circuit 44 is 
connected to the system control circuit 35. The light 
emitting device 14 is provided with a light emitting element 
(laser diode (LD) ) 14a and an illumination lens 14b, and an 
operation of the light emitting element 14a is controlled 
by the light emitting element control circuit 44. The light 
emitting element 14a radiates a laser beam, which is a distance 



measuring light beam or a data transmitting light beam. In 
a distance information sensing operation, the laser beam 
irradiates a whole of a measurement subject through the 
illumination lens 14b, and in a data transmitting operation, 
the laser beam irradiates an area comprising a receiver of 
an optical transmitting system connected with the computer. 
In distance information sensing operation, the laser beam, 
reflected by the measurement subject, becomes incident on 
the photographing lens 11, By detecting the reflected laser 
beam with the CCD 2 8 provided with a plurality of photo-diodes , 
which are two-dimensionally disposed on a surface thereof, 
three-dimensional distance information is sensed as image 
data (three-dimensional image data) , which is described later . 
The data, which is sensed by the CCD 28, is transmitted to 
a computer system by the optical transmitting system, which 
is executed with a light emitting operation of the light 
emitting element 14a. Note that in the above operations, 
a timing of signal charge transferring operations in the CCD 
2 8 is controlled by the system control circuit 35 and the 
CCD drive circuit 30 . 

The liquid crystal display panel 16 and a switch group 
45, including the release switch 15, the mode change dial 
17, the V/D mode switch 18 and the data transmitting mode 
button 24, are connected to the system control circuit 35. 

Fig. 3 schematically illustrates a disposition of the 




camera body 10, the light emitting device 14, the receiver 
47 , the computer system 4 6 and the measurement subject S , 
wherein the distance information sensing operation , which 
detects the distance information relating to the distances 
5 from the camera body to each point on the surface of the 
measurement subject, and the data transmitting operation, 
which transmits the distance data and/or image data from the 
camera to the externally disposed device , such as the computer 
system 46 for example, are carried out. 
10 The distance information sensing operation is carried 

out by radiating the distance measuring light beam from the 
m light emitting device 14 to the measurement subject S, and 

tJ receiving the reflected light beam, which is reflected by 

E3 the measurement subject S and incident through the 

^ 15 photographing lens 11, on the CCD 28. On the other hand, 
the data transmitting operation is carried out by receiving 
and detecting the data transmitting light beam with the 
receiver 47 disposed within the illuminating area U of the 
data transmitting light beam radiated from the light emitting 
20 device 14. The data transmitting light beam detected by the 
receiver 47 is converted to electric signal and transferred 
to the computer system 46 as received data. Then a 
predetermined image processing is performed to the received 
data and a three-dimensional image of the measurement subject 
25 is displayed on the monitor . Note that the distance measuring 
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light beam and the data transmitting light beam, radiated 
from the light emitting device 14, are pulse modulated laser 
beams. Further, a frequency-modulated band of data 

transmitting light beam Is ten times higher than that of the 
5 distance measuring light beam, for example. Thus, each of 
the light beams Is easily discriminated at the receiver 47, 
since each of the frequency-modulated bands Is dissimilar 
from each other. 

With reference to Figs. 4 and 5, a principle behind 
10 a distance measurement In the embodiment Is described below. 
Si Note, In Fig. 5, the abscissa Indicates time "t". 

m A distance measuring light beam output by a distance 

y measurement device B Is reflected by a measurement subject 

C3 S , and the reflected light beam is sensed by a CCD (not shown) . 

-•J 

py 15 The distance measuring light beam is a pulse, the width of 
53 which is ^"H". Accordingly, the reflected light beam is a 

pulse, the width of which is "H", similarly to the distance 
measuring light beam. Therefore, a rise of the pulse of the 
reflected light beam occurs after a rise of the pulse of the 
20 distance measuring light beam by a time 5't (5 is a delay 
coefficient) . Since the distance measuring light beam and 
the reflected light beam have both traveled a distance "r" 
between the distance measurement device B and the measured 
subject S, the distance "r" is represented as follows: 
25 r = 5 - t • C/2 ... (1) 
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wherein ^^C" is the speed of light. 

For example, by setting a condition in such a manner 
that the reflected light beam can only be sensed from a rise 
of the pulse of the distance measuring light beam to a point 
5 prior to a fall of the pulse of the reflected light beam , 
i.e. , by providing a gate pulse corresponding to a reflected 
light beam detecting period T , an amount ^^A" of received light 
from the reflected light beam becomes a function of the 
distance "r" . Namely, the greater the distance "r" (or the 

E a 

yg 10 greater -the -time S'-t) , 'the less -the received light amount: 

m A. 

m 

py In the embodiment , by taking advantage of the principle 

described above, the received light amount A is sensed using 

a 

f J 

each of the photo-diodes (photoelectric conversion elements) 

fi I 

J«S 15 of the CCD 28, the distance from the camera body 10 to each 
point on the surface of the measurement subject S is sensed, 
and data relating to the three-dimensional image, which 
indicates the topography of the measurement subject S, can 
be obtained . 

20 Fig . 6 is a plan view showing a disposition of the 

photo-diodes 51 and a vertical transfer unit 52 , which are 
provided in the CCD 2 8 . Actually , a multitude of photo -diodes 
51 are arranged in a matrix, and a corresponding vertical 
transfer unit 52 is disposed beside each vertical column of 

25 photo-diodes 51. Fig. 7 is a sectioned elevational view of 
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the CCD 28 in which the CCD 28 is cut by a plane perpendicular 
to a substrate 53 . The CCD 28 is an interline CCD of vertical 
overflow drain (VOD) type, in which unwanted charge is 
discharged to the substrate 53. 
5 The photo -diodes 51 and the vertical transfer unit (signal 

charge holding unit) 52 are formed along a surface of the n-type 
siibstrate 53. A plurality of the photo-diodes 51 are 
two-dimensionally disposed in a matrix arrangement, and the 
vertical transfer unit 52 is disposed ad jacent to the photo-diodes 
m 10 51, parallel to rows extending in a vertical direction in Fig. 

m 

FU 5. The vertical transfer unit 52 has four vertical transfer 

fO 

py electrodes 52a, 52b, 52c and 52d, which correspond to each of 

GO 

^ the photo-diodes 51. Therefore, in the vertical transfer unit 

52, four potential wells can be formed, so that a signal charge 
5=2 15 is output from the CCD 28 by controlling a depth of the wells, 
R as is well known. Note that a number of the vertical transfer 

electrodes can be changed, depending upon the requirement of 
the CCD 28. 

The photo-diodes (PD) 51 and the vertical transfer unit 
20 (V-CCD being signal charge holding unit) 52 are disposed in a 

p-type well formed on a surface of the substrate 53. The p-type 
well is completely depleted due to an inverse bias voltage applied 
between the p-type well and the n-type substrate 53. In this 
state, electric charge is accumulated in the photo-diodes 51, 
25 and an amount of the electric charge corresponds to an amount 
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of an Incident: light beam, which Is the reflected light beam 
reflected by the measurement subject. When a substrate voltage 
Is changed to a value greater than a predetermined value , electric 
charge accumulated In the photo-diodes 51 Is discharged to the 
substrate 53. Conversely, when an electric charge transfer 
signal, which Is a voltage signal. Is applied to a transfer gate 
(TG) 54, the electric charge accximulated In the photo-diodes 
51 Is transferred to the vertical transfer unit 52. Namely, 
after the electric charge Is discharged to the substrate 53 by 
the electric charge discharging signal , the signal charge 
accumulated In the photo-diode 51 Is transferred to the vertical 
transfer unit 52 by the electric charge transfer signal . By 
repeating the discharge and the transfer, an electronic 
shuttering operation Is performed. 

Fig . 8 Is a timing chart of a distance Information 
sensing operation by which data , corresponding to the distance 
from the camera body 10 to each point on a surface of the 
measurement subject. Is sensed. The distance Information 
sensing operation Is described below with reference to Figs. 
1,2,6,7 and 8. Note that the timing chart of the distance 
Information sensing operation In the present embodiment Is 
slightly different from the timing chart of the distance 
measurement principle, which was described above with 
reference to Fig. 5. Neimely, the timing chart of the present 
embodiment Is set so as to sense the reflected light beam 



from a point subseqaient to the rise of the reflected light 
beam pulse to a point subsequent to the fall , By this manner, 
a noise component due to an ambient daylight may be reduced, 
though the principles of the above distance measurement means 
5 are basically the same . 

In synchronization with an output of a vertical 
synchronizing signal (not shown) , an electric charge 
discharging signal (a pulse signal) SI is output, so that 
unwanted charge, which is accumulated in the photo-diodes 

C3 

yn 10 51, is discharged to the substrate 53. The electric charge 
flU value, while the pulse signal SI is output, is indicated as 

PU S2 in the chart . After the electric charge discharging signal 

fey SI is output, the light emitting device 14 is actuated, and 

^ thus a distance measuring light beam S3, which is a pulsed 

15 beam having a cons tant width Tg , is output therefrom . Aperiod 
ft for outputting the distance measuring light beam S3 or the 

width of the pulse beam is modulated according to a requirement . 
In the present embodiment, the distance measuring light beam 
S3 is modulated as to be completed approximately 
20 simultaneously with a completion of the output of the electric 
charge discharging signal SI . 

The distance measuring light beam S3 is reflected by 
the measurement subject, and enters the CCD 28 as a reflected 
light beam S4 . When the output of the electric charge 
25 discharging signal SI ends, the electric charge for incident 
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light, which comprises the reflected light beam S4 and an 
ambient daylight, starts on each of the photo-diodes and a 
signal charge S5 is sensed. When an incident of the reflected 
light beam S4 is completed, i.e. after the fall indicated 
5 with a reference sign S6 , the photo-diodes only generate signal 
charge S8 due to the ambient daylight. 

An electric charge transfer signal (pulse signal) S9 
is output only to the vertical transfer electrodes 52a, and 
an electric charge accumulated in the photo-diodes 51 are 
10 transferred to the vertical transfer unit 52 • The operation 

m 

Rij of transferring the accumulated electric charge in the 

Co 

py photo-diodes 51 ends with the fall SIO, which is a termination 

ty of the output of the electric charge transfer signal S9. 

C3 Namely, a signal charge Sll of which electric signal 

15 accumulation was started just after the completion of the 
electric charge discharging signal output and terminated just 
after the completion of the output of the electric transfer 
signal S9, is transferred to the vertical transfer unit 52, 
while the photo-diodes continue to accumulate electric 
20 signals S14 due to the ambient daylight. 

Thus during a period Tui from the end of the output 
of the electric charge discharging signal Si to the end of 
the output of the electric charge transfer signal S9, a signal 
charge Sll, corresponding to distances from the camera body 
25 10 to the measurement subject and the ambient daylight is 
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accumulated in the photo-diodes 51. Namely, the signal 
charge S12 , a hatchedportion of signal charge Sil , corresponds 
to the distances from the camera body 10 to the measurement 
subject, while a residual portion S13 of the signal charge 
5 Sll results from the ambient daylight. 

When a predetermined time has elapsed since the output 
of the electric charge transfer signal S9, a subsequent 
electric charge discharge signal is output, so that the signal 
charge S14 , an electric charge accumulated in the photo-diodes 

a 

=jy 10 after the signal charge transfer to the vertical transfer 

in 

FU unit 52, is discharged to the substrate 53. Subsequently, 

^ another signal charge is accumulated in the photo-diodes 51. 

^ Then, similarly to the above description, when the electric 

H charge accumulation period Toi has again elapsed, the signal 

15 charge Sll is transferred to the vertical transfer unit 52. 
Pi The transferring operation of the signal charge Sll 

to the vertical transfer unit 52 is repeatedly performed until 
the next vertical synchronizing signal (not shown) is output. 
Thus, the signal charge Sll is integrated in the vertical 
20 transfer unit 52 . The signal charge Sll integrated for one 
field period, which is between two vertical synchronizing 
signals, corresponds to distance information of the 
measurement subject, on condition that the measurement 
subject is stationary for the period between the two vertical 
25 synchronizing signals. 
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The de'tec'blzig operation o£ the signal charge Sll 
described above Is carried out In all o£ the photo-diodes 
51 provided In the CCD 28, As a result of the detecting 
operation for one field period^ the distance Information 
sensed by the photo-diodes 51 Is held In each corresponding 
vertical transfer unit 52, which Is located adjacent to each 
column of photo-diodes 51 . The distance Information Is 
output from the CCD 28 by a vertical transferring operation 
of the vertical transfer units 52 and a horizontal transferring 
operation of a horizontal transfer unit (not shown) . The 
distance Information Is then output from the CCD 28 . 

The reflected light beam detected by the CCD 28 Is 
affected by the reflectance of the surface of the subject. 
Therefore, the distance Information obtained through the 
reflected light beam contains error derived from the 
reflectance. Further, the light beam sensed by the CCD 28 
may contain an extra component, such as ambient daylight, 
being other than the reflected light beam from the measurement 
subject, which can cause an error . A description for methods 
of correcting such errors are given In the following, as a 
part of a flowchart showing the distance Information sensing 
operation and data transmitting operation. 

Fig . 12 through Fig . 14 are a flow chart of the distance 
Information sensing operation and data transmitting operation 
executed In the camera of the first embodiment . Fig . 9 through 



Fig. 11 are respective timing charts of a distance correction 
information sensing operation, a reflectance information 
sensing operation and a reflectance correction information 
sensing operation of the first embodiment. 

When it is recognized in Step 101 that the release 
switch 15 is fully depressed. Step 102 is executed in which 
it is determined which mode is selected, a video (V) mode 
or a distance measurement (D) mode. A change between the 
modes is carried out by manually operating the V/D mode switch 
18 . 

When the D mode is selected. Step 103 is executed in 
which the vertical synchronizing signal is output and a 
distance measuring light beam control is started. Namely, 
the light emitting device 14 is driven so that the distance 
measuring light beam S3 is intermittently output as a pulsed 
beam. Then, Step 104 is executed so that a sensing operation 
control of the CCD 28 is started. Namely, the distance 
information sensing operation described with reference to 
Fig. 8 is started, and thus the electric charge discharging 
signal SI and the electric charge transfer signal S9 are 
alternately output, so that the signal charge Sll of the 
distance information is integrated in the vertical transfer 
unit 52. 

In Step 105, it is determined whether one field period 
has elapsed since the beginning of the distance information 



sensing operation , i.e., whether a new vertical synchronizing 
signal has been output. When one field period has passed, 
the process goes to Step 106 in which the signal charge Sll 
of the distance information is output from the CCD 28. The 
5 signal charge Sll is then temporarily stored in the image 
memory 34 in Step 107. Then, in Step 108, the distance 
measuring light beam control is turned OFF , and thus the light 
emitting operation of the light emitting device 14 is 
terminated . 

^10 In Steps 109 through 112, the distance correction 

py information sensing operation is performed. In Step 109, 

fy a vertical synchronizing signal is output, and a sensing 

by operation control of the CCD 28 is started. Namely, as shown 

C3 in Fig. 9, an electric charge discharging signal S21 and an 

^ 15 electric charge transfer signal S22 are alternately output 
% while the light emitting operation of the light emitting device 

14 is not carried out, i.e., while the light source is not 
illuminated. Although the electric charge accumulation 
period Tui is the same as that of the distance information 
20 sensing operation shown in Fig. 8, the distance measuring 
light beam does not irradiate the measurement subject 
(reference S23) , and thus there is no reflected light beam 
(reference S24) . Therefore, although a signal charge of the 
distance information is not generated, a signal charge S25 
25 corresponding to an interference or noise component is 
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genera'bed/ since the noise component: , such as ambient daylight , 
enters the CCD 28 . When an electric charge transfer signal 
S22 is output, a signal charge S26 , a charge accumulated during 
the electric charge accumulation period Tui , is transferred 
to the vertical transfer unit 52. The signal charge S26 
corresponds to distance correction information, which is used 
for correcting an error generated in the distance information 
due to the noise component, and is related to the electric 
charge accumulation period Toi . 

In Step 110 , it is determined whether one field period 
has elapsed since the beginning of the distance correction 
information sensing operation, i.e. , whether a new vertical 
synchronizing signal has been output. When one field period 
has passed, the process goes to Step 111 in which the signal 
charge 326 of the distance correction information is output 
from the CCD 28. The signal charge S2 6 is then temporarily 
stored in the image memory 34 in Step 112 . 

In Steps 113 through 117, the reflectance information 
sensing operation is performed. In Step 113, a vertical 
synchronizing signal is output , and a distance measuring light 
beam control of the CCD 28 is started. Namely, as shown in 
Fig . 10 , a distance measuring light beam S33 is intermittently 
output as a pulsed beam. In Step il4, a sensing operation 
control of the CCD 28 is started, and thus an electric charge 
discharging signal S31 and an electric charge transfer signal 



S35 are alternately output. The electric charge of 
photo-diodes is discharged (reference S32) as the electric 
charge discharge signal S31 is output. After completion of 
an output of the electric charge discharge signal S31, a 
distance measurement light beam S33 is emitted from the light 
emitting device 14, and a reflected light beam S34 is made 
incident on the CCD 28. An electric charge transfer signal 
S35 is output after a period sufficient to detect the entire 
reflected light beam S34 . Namely, the reflectance 

information sensing operation is controlled in such a manner 
that all of the reflected light beam S34 is received within 
an electric charge accumulation period Tu2 / which is from an 
end of an output of the electric charge discharging signal 
S31 to an end of an output of the electric charge transfer 
signal S35 . Note that, a width Tg of the signal charge S33 
accumulated in each of the photo-diodes 51 of the CCD 28 is 
the same as a width Ts of the distance measuring light beam 
S33 . 

During a period in which all of the reflected light 
beam S34 is sensed, a signal charge S36 accumulated in the 
photo-diodes 51 is due to the reflected light beam S34 and 
the ambient daylight. The signal charges S37 and S38 are 
charges generated only by the ambient daylight. When the 
electric charge transfer signal S35 is output, the signal 
charge S39 is transferred to the vertical transfer unit 52 . 



Therefore, the signal charge, which Is detected during 
the electric charge accumulation period Tu2 / Including the 
signal charge S'39 generated by the ambient daylight, does 
not depend upon the distance of the measurement subject, and 
corresponds to the reflectance Information which depends on 
the reflectance of the surface of the measurement subject. 

In Step 115 , It Is determined whether one field period 
has elapsed since the beginning of the reflectance Information 
sensing operation , i.e., whether a new vertical synchronizing 
signal has been output. When one field period has passed, 
the process goes to Step 116 in which the signal charge S39 
of the reflectance information is output from the CCD 28 . 
The signal charge S39 is then temporarily stored in the image 
memory 34 in Step 117. Then, in Step 118, the distance 
measuring light beam control is turned OFF, and thus the light 
emitting operation of the light emitting device 14 is 
terminated . 

In Steps 119 through 122, the reflectance correction 
information sensing operation is performed. In Step 119, 
a vertical synchronizing signal is output, and a sensing 
operation control of the CCD 28 is started. Namely, as shown 
in Fig. 11, an electric charge discharging signal S41 and 
an electric charge transfer signal S42 are alternately output 
while the light emitting operation of the light emitting device 
14 is not carried out. Although the electric charge 
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accumulation period Tu2 Is the same as that of the reflectance 
information sensing operation shown in Fig. 10, the distance 
measuring light beam does not irradiate the measurement 
subject (reference S43) , and thus there is no reflected light 
beam (reference S44). Therefore, although a signal charge 
of the reflectance information is not generated, a signal 
charge S46 corresponding to an interference component or a 
noise component is generated, since the noise component, such 
as ambient daylight, enters the CCD 28. A signal charge S47 
is a charge accumulated during the electric charge 
accumulation period Tu2 and is transferred to the vertical 
transfer unit 52 by the electric charge transfer signal S42 . 
The signal charge S47 corresponds only to reflectance 
correction information, which is used for correcting an error 
generated in the reflectance information due to the noise 
component, and is related to the electric charge accumulation 
period Tu2 - 

In Step 120, it is determined whether one field period 
has elapsed since the beginning of the reflectance correction 
information sensing operation, i.e. , whether a new vertical 
synchronizing signal has been output. When one field period 
has passed, the process goes to Step 121 in which the signal 
charge S46 of the reflectance correction information is output 
from the CCD 28. The signal charge S47 is temporarily stored 
in the image memory 34 in Step 122 . 



In Step 123, a calculation process of the distance 
measurement (D) data is performed using the distance 
information, the distance correction information, the 
reflectance information and the reflectance correction 
information, which are obtained in Steps 103 through 122. 
The D data is output and stored in the image memory 34 in 
Step 124. The distance information sensing operation ends 
with Step 124 and the data transmitting operation then starts . 
The data transmitting operation is shown in the following 
steps of Step 128 . Conversely, when it is determined in Step 
102 that the V mode is selected, the distance measuring light 
beam control is turned OFF in Step 125, and a normal 
photographing operation (i.e. , CCD video control) is turned 
ON. Then, the image of the measurement subject is sensed 
and the corresponding image data is stored in the image memory 
34 at step 127. By this, the image sensing operation or 
photographing operation ends and the data transmitting 
operation is executed in the steps succeeding Step 128 . 

In Step 128 through Step 130, the data transmitting 
operation is performed . In Step 12 8, it is determined whether 
the data transmitting mode is set. When it is determined 
that the data transmitting mode is set, the process proceeds 
to Step 129. On the other hand, when it is determined that 
the data transmitting mode is not set, the data stored in 
the image memory 34 are recorded in the recording medium M 
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in Step 131, then process returns to Step 101. The data 
transmitting mode is set by manually operating the data 
transmitting mode button 24. Namely, when the data 
transmitting button 24 is pressed, the data transmitting mode 
5 is set, and when it is pressed once more , the mode is canceled . 

In Step 129, it is determined whether preparations 
for the data transmission are complete. When the 

preparations are complete, at Step 130 the pulse modulated 
data transmitting light beams, which is modulated according 
.1^10 to the modulation signal of the data, are radiated from the 
m light emitting device 14 . When the entire data is transmitted 

If 

PU to the computer system 36, the process returns to Step 101 

rg 

^ and the process stands by until the release switch 15 is fully 

C3 depressed. On the other hand, at Step 12 9 when it is determined 

L^' 15 that the preparation for the data transmitting is not complete , 
it the process stands by at Step 129. 

Next , with reference to Figs . 8 through 11 , the contents 
of the calculation executed in Step 123 is described below. 

It is supposed that the measurement subject of 
20 reflectance R is illuminated and an image of the measurement 
subject is formed on the CCD 28 while regarding the measurement 
subject to be a two-dimensional light source. At this time, 
an output Sn, which is obtained by integrating an electric 
charge generated in a photo-diode for an electric charge 
25 accumulation period "t", is indicated as follows: 
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wherein "k" is a proportional coefficient, which is varied 
in accordance with an F-number and a magnification of the 
photographing lens . 

When the measurement subject is illuminated by light 
output from a light source, such as an infrared laser source, 
the luminance I is obtained by combining a luminance Is/ due 
to the light source and a luminance Is due to the ambient light , 
which is indicated as follows : 

I = Is + Ib ... (3) 

As shown in Fig. 8, it is supposed that the electric 
charge accumulation period is Tui , the pulse width of the 
distance measuring light beam S3 is Ts, a pulse width of the 
signal charge S6 of the distance information is Td , and the 
electric charge accumulation period is repeated N times (a 
predetermined number of times) for one field period. An 
output SMio of the CCD is : 

SMio = ZdcRds-Tc + Ib Tui)) 

= k-NR(Is Td + Ib'Tui) ...(4) 
wherein the pulse width Td is indicated as follows : 

Td = 5 • t 

= 2r/C ... (5) 

As shown in Fig. 10, when the electric charge 
accumulation period Tu2 is greater than the pulse width Ts, 
such that the electric charge accumulation period Tu2 is large 



enough t:o receive -the whole of t:he reflected light: beam, an 
output SM20 of the CCD is : 

SM20 = Z(k-R{Is"Ts + IB-Ta2)) 

= k-N-R(Is-Ts + Ib-Tu2) .--(6) 
5 As shown in Fig. 9, when the light beam is turned OFF 

to carry out: a pulse-shaped electric charge accumulation , 
having a same width as that of Fig. 8 an output SMu of the 
CCD is : 

SMii = Ib-Tui) 
10 = k-N-R-Ia-Tai ...(7) 

PU Similarly, an output Sn of the CCD, which is obtained when 

Co 

ry an electric charge accumulation shown in Fig . 11 is performed. 



SM21 = Z(k-R-lBTu2) 
15 = kNR lBTu2 ...(8) 

Based on the formulas (4) , (6) , (7) and (8) , a following 
formula is obtained: 

Sd ~ (SMio SMii) / ( SM20 "~ SM21) 

= Td/Ts ... (9) 

20 As described above, the distance measuring light beam 

S3 and the reflected light beam S4 contain noise, such as 
ambient daylight (i.e. , a luminance Ib due to ambient daylight) 
Td/Ts included in the formula (9) indicates that an amount 
of the reflected light beam S4 from the measurement subject, 
25 when the distance measuring light beam S3 is radiated, is 
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normalized by an amoun'b of the distance measuring light beam 
S3, and is equal to a ratio of a' value in which the noise 
component (SMu) (corresponding to the electric charge S26 
shown in Fig. 9) is subtracted from the amount of the distance 
measuring light beam S3 (SMio) (corresponding to the signal 
charge Sll shown in Fig. 8), to a value in which the noise 
component (SM21) (corresponding to the electric charge^^^S-'-S^ 
shown in Fig, 11) is subtracted from an amount of the reflected 
light beam S4 (SM20) (corresponding to the signal charge^S^^ 

to 

shown in Fig .y^?^ - 

SMio, SMii , SM20 and SM21 included in the formula (9) 
are stored as the distance information, the distance 
correction information, the reflectance information and the 
reflectance correction information, in Steps 107, 112, 117 
and 122, respectively. Therefore, based on the information , 
Td/Ts is obtained. Since the pulse width Ts is known, the 
distance r is obtained from formula (5) and Td/Ts. Thus, based 
on the formula (5) and (9) , the distance r from the camera 
body to each point on the surface of the measurement subject 
is corrected, so that an accuracy of a distance sensing is 
improved. 

Fig . 15 is a flow chart of a data Lx aiis mar- tt i ng o pf^rat i^-n 

A 

executed on the computer system 46. 

The receiver 47 is initially set to detect a distance 
measuring light beam. Namely, a frequency modulated laser 



beam in the band of the distance measuring light beam is only 
detectable. When the receiver 47 detects a distance 
measuring light beam in Step 201, the process proceeds to 
Step 202 , in which a timer is set . In Step 203 , it is determined 
5 whether a predetermined time has passed since the timer was 
set. When the predetermined time has not elapsed, it is then 
determined whether the data transmission has started . Namely , 
it is checked whether the receiver 47 has detected a data 
transmitting light beam, a band of which is ten times, for 
In 10 example, that of the distance measuring light beam. If a 

m data transmitting light beam has not been detected, the process 

CO 

f^y goes to Step 203, and it is again determined whether the 

E3 

fcy predetermined time has elapsed since the timer was set. When 

p the elapsed time of the timer is beyond the predetermined 

15 time, the process returns to Step 201, and prepares for the 

subsequent distance measuring light beam, which may be 

detected . 

In Step 204 when a transmission start signal of the 
data transmitting light beam, for example, is detected by 

20 the receiver 47, so that it is determined that the data 
transmission has started, then in Step 205, the data 
transmitting light beams , which are transmitted from the light 
emitting device 14 of the camera in Step 130, are detected 
by the receiver 47 and are input to the computer system 46 

25 as distance data and image data . In Step 206, it is determined 
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whether a detecbed light beam, for example, corresponds to 
a transmission end signal. When the detected light beam 
corresponds to the transmission end signal, the receiving 
operation is terminated and the process returns to Step 201, 
at which the process stands by until the subsequent distance 
measuring light beam is detected. When the detected light 
beam is not the transmission end signal, the process returns 
to Step 205 and the succeeding light beam is detected. 

As described above , according to the first embodiment , 
the miniaturized light weight handy three-dimensional image 
capturing device, which can transmit data to the computer 
system with no cable between, is obtained. 

Fig. 16 is a perspective view of a camera type optical 
reader (three-dimensional image capturing device) of a second 
embodiment of the present invention . The external view of 
the camera in the second embodiment is the same as that of 
the first embodiment except for the data transmitting mode 
button 24, which is shown in Fig. 1. 

Fig. 17 is a block diagram showing an electrical 
construction of the camera of Fig .16. Most of the structure , 
which is shown in Fig. 17, is the same as the structure shown 
in Fig. 2, which describes the electrical construction of 
the camera in the first embodiment. However, the camera in 
the second embodiment has a data pulse generating circuit 
29, which generates data pulses and superposes the pulses 



onto an LD driving pulse. Namely, the light emitting element 
control circuit 44 is controlled by the system control circuit 
35 through the data pulse generating circuit 29. 

Fig. 18 is a flow chart of a distance information 
sensing operation and a data transmitting operation executed 
in the second embodiment. The above operations are executed 
in the arrangement illustrated in Fig . 3 . 

In the second embodiment, the signal charge S13, shown 
in Fig. 8, due to the ambient daylight is ignored, since the 
amount of signal charge S13 is regarded as small enough to 
ignore when it is compared with the amount of signal charge 
S12 - Further, influence of the reflectance information is 
also omitted so as to simplify the description. Namely, in 
the second embodiment, the distance correction information 
sensing operation, the reflectance information sensing 
operation and the reflectance correction information sensing 
operation, which are executed in the first embodiment, are 
omitted. Therefore, the process described from Step 109 to 
Step 122 in Fig. 12 and Fig. 13 is reduced. Note that, the 
above three operations may be carried out additionally if 
required . 

When switch 15 is fully depressed in Step 301, then 
Step 302 is executed in which it is determined which mode 
is selected, a video (V) mode or a distance measurement (D) 
mode . 



When the D mode is selected , a data superposing 
operation, which is described later, is executed in Step 303. 
In Step 304, the vertical synchronizing signal is output and 
a distance measuring light beam control is started. Namely, 
the light emitting device 14 is driven so that the distance 
measuring light beam S3 is intermittently output as a pulsed 
beam. Subsequently, Step 305 is executed so that a sensing 
operation control of the CCD 28 is started. Namely, the 
distance information sensing operation is started, and the 
signal charge Sll (see Fig. 8) of the distance information 
is integrated in the vertical transfer unit 52 , as described 
in the first embodiment. 

In Step 306, it is determined whether one field period 
has elapsed since the beginning of the distance information 
sensing operation , i.e., whether a new vertical synchronizing 
signal has been output . When one field period has not passed, 
the process returns to Step 303. On the contrary, when one 
field period has passed, the process goes to Step 307 in which 
the signal charge Sll of the distance information is output 
from the CCD 28. The signal charge Sll is then temporarily 
stored in the image memory 34 in Step 308. In Step 309, the 
distance measuring light beam control is turned OFF, and thus 
the light emitting operation of the light emitting device 
14 is terminated. With the above operations, signal charge 
Sll, due to each reiterated radiation, is accumulated in the 
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CCD 28 for a predetermined number of times or one field period . 

In Step 310, a calculation process of the distance 
measurement (D) data is performed using the distance 
information, which is obtained in Steps 304 through 308 . The 
5 D data is output and stored in the image memory 34 in Step 
311. Conversely, when it is determined, in Step 302, that 
the V mode is set, the process goes to Step 312. In Step 
312 , the distance measuring light beam control is turned OFF, 
and a normal photographing operation (i.e., CCD video control ) 
JS 10 is turned ON, in Step 313. Then, the image of the measurement 

fin 

py subject is sensed and the corresponding image data is stored 

mj in the image memory 34 in step 314, and the process returns 

W to the first step. Step 301. 

H Note that, the contents of the calculation process 

Lt' 15 for the distance measurement (D) data, which is executed in 
2% Step 310, is similar to the contents described in the first 

embodiment. Namely, D data is obtained from the formula (4) 
and (5) with Ib assumed to be zero in the formulas, and the 
reduced formula is described in the following form. 
20 r = C SMio/ (2 KNR-Is) ...(10) 

Next, the process of the data superposing operation, 
which is executed in Step 303, is described with reference 
to Fig. 18 through Fig. 21. 

Each of Fig. 19A and Fig. 19B describes a sequence 
25 of the pulse beam radiation at the light emitting device 14, 



39 



with reference to the accumulating period of the signal charge 
in the CCD. Fig. 19A shows a sequence of the pulse beam with 
no data superposing operation , and Fig. 1 9& shows the sequence 
^with the data superposing operation^. 
5 As for the timing of the accumulation of signal charge 

and the radiation of the distance measuring light beam 851, 
there is no difference between the operation (corresponding 
to Fig. 19B) with the data superposing process and the 
operation (corresponding to Fig. 19A) without the data 
yg 10 superposing process. However, in the case of the operation 

in 

rU with the data superposing , a set of pulse beam signals S52 

that correspond to the transmitting data is radiated for a 
^ data period T^, an interval between the subsequent radiations 

r^, of the distance measuring light beams S51 . Namely, an 

^ 15 accumulation of the signal charge in a photo-diode 51, which 
continues for the period Toi , approximately simultaneously 
begins with a fall of the distance measuring light beam S51 . 
When a predetermined time elapses from the completion of the 
accumulation in the photo-diodes 51, the pulse beams S52 , 
20 which represent the transmitting data, are radiated for the 
period . After a predetermined interval, a blank period 
Tb / from the end of the data period T^/ in which a set of the 
pulse beam S52 is radiated, the subsequent distance measuring 
light beam S51 is emitted. Thus, the period (T^ + Tb) / which 
25 is composed of the data period and the blank period Tb , 
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is comprised in the interval between the fall of the electric 
charge transfer signal S 10 and the fall of the electric charge 
discharging signal (refer Fig. 8) . The above operations 
continuously repeat until one field period elapses. Note 
5 that, the data transmitted in the above operations are distance 
data or image data, the data of which is sensed in the distance 
information sensing operation and stored in the image memory 
34. Further, the data may comprise control data as required. 

Each set of pulse beams S52 , which is illustrated in 
10 Fig. 19B, represents 8 bits data, which corresponds to the 
ffy binary number indicated under each of the pulse beams , as 

PU an example. Namely, data period Ta is equally divided into 

W eight intervals, and each interval corresponds to a binary 

S3 digit. If there is a radiation of a pulse beam during an 

15 interval corresponding to a digit of an 8 bits number, the 
corresponding digit is "1", and if not, it is "0". Further, 
the distance measuring light beam S51 is also used as a 
synchronizing signal for the transmitting operations between 
the camera and the computer system, and each set of pulse 
20 beams S52 is emitted from the light emitting device when a 
predetermined period elapses from an end of each accumulating 
period Tui . 

Fig. 20 is a flow chart of the data superposing 
operation which is executed in Step 303 of the flow chart 
25 described in Fig. 18. The data superposing operation is 
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carried out when it is determined that the mode is set to 
D mode, in Step 302 of Fig. 18. In Step 401, a determination 
is made to confirm the existence of data to be transmitted. 
If there is data to be transmitted, in Step 402, an 8 bits 
5 data is read out from the image memory 34 and transformed 
to the signal which is to be superposed onto an LD driving 
pulse for driving the light emitting device (LD) 14. Then, 
data pulse that represents the 8 bits transmitting data is 
superposed onto the LD driving pulse and output from the data 

yQlO pulse generating circuit 29 in Step 403, and the process for 

on 

ilJ data superposing operation for one set (8 bits) of data ends, 

ry On the contrary, when it is determined, in Step 401, that 

^ there is no data to be transmitted, this process ends with 

^1 no superposing operation. Namely, the radiating sequence 

L-S 15 of the light emitting device 14 becomes the same as the sequence 
25 shown in Fig. 19A, in which the radiating sequence includes 

no data superposing process . 

When the data superposing operation ends, the process 
goes to Step 304 (see Fig. 18), in which the vertical 
20 synchronizing signal may be output, and the radiation of the 
light emitting device 14 is controlled as to the LD driving 
pulse onto which the data pulse may be superposed in Step 
403. Namely, since the processes from Step 303 through Step 
306 are repeatedly executed for one field period, when there 
25 is data to be transmitted, the light emitting device 14 
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radiates pulse beams in the sequence shown xn Fig. 19B, and 
the distance measuring operation Is executed In the manner 
described In the previous description. 

A receiving operation of a data transmitting light 
5 beam In the second embodiment, which Is carried out In the 
computer system 46, Is described In the following with 
reference to Fig .21, which shows a flow chart of the operation . 

When a pulse beam, which Is radiated from the light 
emitting device 14, Is detected In the receiver 47, In Step 
yS 10 501, the process proceeds to Step 502 In which a sensing 
rU operation of pulse beam signals S52 Is started . In Step 503 , 

the Image processing Is performed to the Image data and/or 

£3 

the distance data, which are successively received In Step 
502, and displayed on the monitor of the computer system 46. 

15 In Step 504, It Is determined whether to terminate the 
f3 receiving operation . If a key In the keyboard of the computer 

system 46 that Is assigned to ending the process of the 
receiving operation Is pressed, for example, the operation 
Is terminated, and If not, the process goes back to Step 501 

20 and stands by for the next detection. 

As described above , according to the second embodiment , 
the same advantage as the first exabodlment Is obtained. 
Further, In the second embodiment, the distance measuring 
light beams and the data transmitting light beams are 

25 superposed, so that the distance Information sensing 
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operation and the data transmitting operation are 
simultaneously executed, thus the efficiency of the data 
transmission improves . 

With reference to Fig. 22, a third embodiment of the 
present invention is described in the following. A 
difference between the second and third embodiment is only 
in a sequence of the radiation of the light emitting device 
14. So that, in the second and third embodiment , a mechanical 
construction and an electrical construction are the same . 

Fig. 22 shows a radiating sequence of the pulse beam 
of light emitting device (LD) 14, with reference to the 
accumulating period of the signal charge in the CCD 28. 

In the third embodiment, the transmitting data is 
superposed onto the distance measuring light beams by 
modulating the duration of the pulse beams S55. The 
modulation, a pulse-width modulation, is achieved by 
modulating a leading-edge of the pulse beams, in other words, 
by changing a timing of the rise. Namely, a pulse beam S55 
is modulated such that a width of which is either Ts or Tg 
+ Td- The period Td/ the leading part of the pulse , is a period 
for the data, and period Ts, the trailing part of the pulse, 
is a period for the distance measuring light beam. The pulse 
beams regularly occur in the periods Ts , which are the trailing 
parts of the pulse beams S55, so that each of the pulse beams 
in the periods Ts correspond to each of the accumulating periods . 



On the contrary, in the periods Td, which are the leading 
parts of the pulse beam S55 , an occurrence of the pulse beam 
is dependent on the data. Namely, when a pulse beam occurs 
in the period T^/ it represents "1" of a binary digit, and 
5 if not it represents "0" of the same. Therefore, a pulse 
beam S55 with the pulse width Ts represents "0", and a pulse 
beam S55 with the pulse width Ts + Td represents "1". By 
repeatedly radiating the pulse beams S55 , the widths of which 
are modulated in the above manner, for one field period, the 
-Jg 10 data in the camera is transmitted to the computer system 46. 
fiy Note that a data superposing operation in the present 

py embodiment is also carried out in Step 303, as mentioned in 

the second embodiment. Further, timing of the data period 
Td is set so as not to affect the distance information sensxng 
15 operation. 

As described above , according to the third embodiment, 
the same advantage as the second embodiment is obtained. 

With reference from Fig. 23 through Fig. 30, a fourth 
embodiment of the present invention is described. The 
20 mechanical configuration of the present embodiment is the 
same as those in the previous embodiments. So, the 
perspective view of a camera type three-dimensional image 
capturing device in the fourth embodiment is the same as Fig. 
1. Further, the device is also utilized in the arrangement 
25 shown Fig. 3. 
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Fig. 23 is a block diagram showing an electrical 
construction of the fourth embodiment. The electrical 
construction of the fourth embodiment is similar to the 
embodiments described above except for blocks relating to 
the CCD driving pulse and the LD driving pulse. 

An operation of the light emitting element 14a is 
controlled by the light emitting element control circuit 44, 
and the light emitting element control circuit 44 is controlled 
by the pulse signal output from the delay circuit 45. The 
pulse signal, which is output from the delay circuit 45, is 
a data pulse signal output from the data pulse generating 
circuit 29, a phase of which is delayed at the delay circuit 
45. Further, the data pulse signal is a sequential pulse 
signal that represents the transmitting data with certain 
binary digits, and the data pulse generating circuit 29 is 
controlled by the system control circuit 35. 

The light emitting element 14a radiates laser pulse 
beams that comprise the distance measuring light beams and 
the data transmitting light beams, which are superposed with 
each other. Thus, the receiver 47 receives and detects the 
laser beams, and the data in the camera is transmitted to 
the computer system 4 6 . The data pulse signal , which is output 
from the data pulse generating circuit 2 9 to the delay circuit 
45, is also output to the CCD driving pulse converter 51 and 
counter 39 , simultaneously . The counter 39 counts the number 



of the data pulses and outputs the number to the system control 
circuit 35 . 

In the D mode CCD driving pulse generator 23 , a standard 
CCD driving pulse, which is a standard pulse signal for the 
5 distance measuring sensing operation , is generated and output 
to the CCD driving pulse converter 51 . The CCD driving pulse 
converter 51 converts the standard CCD driving pulse to the 
CCD driving pulse that controls the accumulating operation 
of the signal charge in CCD 28, so that the accumulation is 
10 performed synchronously with the light emitting operation 

fin 

of the light emitting element 14a based on the data pulse. 



The CCD driving pulse is then output to the CCD drive circuit 
30 via V/D switch 22. 

3 In the V mode CCD driving pulse generator 41, the CCD 

•4 

y 15 driving pulse that performs the normal video control of the 
;: CCD 28 is generated, and the CCD driving pulse is output to 

the CCD drive circuit 30 via the V/D switch 22 . The V/D switch 
22 alternatively outputs the CCD driving pulse from the V 
mode CCD driving pulse generator 41 or the CCD driving pulse 
20 converter 51 to the CCD drive circuit 30 in accordance with 
the mode selected by the V/D mode switch 18. The V/D switch 
22, the V mode CCD driving pulse generator 41 and the D mode 
CCD driving pulse generator 23 are controlled by the system 
control circuit 35. 
25 Fig . 24 shows a timing chart of the distance information 



4 7 



sensing opera'txon in -bhe £ourt:h embodlmen't . The "timing In 
the present embodiment Is slightly different from the timing 
shown In Fig. 8. In the present embodiment, the electric 
charge transfer signal S9' Is output approximately 
simultaneously with the completion of -the electric charge 
discharging signal SI. The rest of the timing chart Is the 
same as that In Fig. 8. Thus the distance Information Is 
obtained In the manner described In the second embodiment. 

Further, the flow chart of the dls-tance Information 
yu 10 sensing operation In -the present embodiment Is also the same 

rU as that of t:he second embodiment shown In Fig. 18. 

CO 

Fig . 25 describes the flow chart of -the data superposing 

.£p 

^ operation In the fourth embodiment. This operation Is 

3 

f ^ 

'r^z executed In Step 303 In Fig. 18. 

15 In Step 601, the existence of the transmitting data 

n 

Is confirmed. When the transmitting data exists, the data 
Is read out from the Image memory 34 In Step 602, and the 
data pulse signal of the data Is generated In the data pulse 
generating circuit 29. The data pulse signal Is then output 

20 to the delay circuit 45, the counter 39 and the CCD driving 
pulse converter 51. In Step 603, the data pulse signal Is 
delayed In the delay circuit 45 and output to the light emitting 
control circuit 44, as the LD driving pulse, which controls 
the light emitting element 14a. Further, at the same time, 

25 the CCD driving pulse converter 51 converts the standard CCD 
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driving pulse , which is genera'ted in the D mode CCD driving 
pulse generator 23, to the CCD driving pulse, so that the 
accumulation of the electric charge in the photo-diodes 51 
may be matched with the light emitting operation of the light 
5 emitting element 14a, which is controlled by the data pulse, 
for the distance information sensing operation. Then the 
superposing operation ends . 

On the other hand, when it is determined in Step 601 
that there is no data to be transmitted, the process proceeds 
1^ 10 to Step 604 and dummy data is generated in the system control 
p!i circuit 35, The dummy data is generated for carrying out 

iy the distance information sensing operation even though the 

y transmitting data does not exist. Namely, the dummy data 

□ is only used for instructing the timing of the distance 

15 measuring light beam radiation, and it has no specific 
information as transmitting data. The dummy data is output 
to the data pulse generating circuit 29 and a corresponding 
data pulse is generated. The data pulse is then output to 
the delay circuit 45, counter 39 and CCD driving pulse 
20 converter 51 . 

In Step 603 , the data pulse of the dummy data is delayed 
in the delay circuit 45, and output to the light emitting 
control circuit 44 as the LD driving pulse, which controls 
the light emitting element 14a. Further, at the same time, 
25 the CCD driving pulse converter 51 converts the standard CCD 



m 
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driving pulse, which is genera'bed in the D mode CCD driving 
pulse generator 23, to the CCD driving pulse, so that the 
accumulation of the electric charge in the photo-diodes 51 
may be matched with the light emitting operation of the light 
5 emitting element 14a, which is controlled by the data pulse 
of the dummy data, for the distance information sensing 
operation. Then the superposing operation ends. 

With reference to Fig. 26 and Fig. 27, the data 
superposing operation of the fourth embodiment is described 
% 10 in the following. Fig. 26 shows the detail of the CCD driving 

in 

pulse converter 51 and blocks that relate to the data 
pj superposing operation in the block diagram shown in Fig 23. 

y Further, Fig. 27 describes the sequence of the pulse signals 

O output from the circuits or blocks shown in Fig. 26, the 

15 accumulating period of the photo-diodes 51 and pulse beams 
radiated from the light emitting device (LD) 14. 

A pulse pair S61 represents a partition signal that 
delimits a sequence of the transmitting data by predetermined 
binary digits of the data. Namely, the period Td/ from the 
20 first rise of a pulse pair S61 to the first rise of the next 
pulse pair S61, is one data period. For example, the 
transmitting data is 8 bits data, and the transmitting data 
is divided by the partition signal S61 for each set of 8 bits 
data. The 8 bits data pulse in each data period is output 
25 during a period Tp of the data period. The period Tp comprises 
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eight digit periods , and each of the digit periods corresponds 
to one digit of the 8 bits data. If a pulse exists in a digit 
period, the value of corresponding digit is "1", and if not, 
corresponding digit is "0". 
5 A binary nuzaber indicated in each data period 

represents a transmitting data of 8 bits . Each digit of these 
8 bits binary number corresponds to a digit period of the 
period Tp one-to-one. Namely, the first digit of the binary 
number corresponds to the rightmost digit period Bl of the 
f:S 10 period Tp , and the second digit to the second digit period 

cn 

py from the right, the digit period B2 . Each digit corresponds 

ry to each digit period, respectively, thus the eighth digit 

fcy corresponds to the eighth digit period from the right or the 

leftmost digit period B8 . For example, in the second data 
15 period from the left side of Fig. 27, the corresponding 
'^i transmitting data is "00101000" of which the fourth and sixth 

digit are "1" and the remaining digits are "0", thus a pulse 
only exists in the fourth and sixth digit periods from the 
right. Namely, the pulse S62 corresponds to the sixth digit 
20 and the pulse S63 to the fourth digit. Further, 8 digits 
binary data in the third data period from the left is "11100001" 
of which the upper three digits are all "1", so a pulse exists 
in each of the corresponding three digit periods . 
Consequently, the three pulses, each in consecutive digit 
25 periods, compose a single continuous pulse S64. 
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A data pulse shown in Fig. 27 is trans£erred to the 
light emitting drive circuit 44 as a LD driving pulse through 
the delay circuit 45 . The seqpience of the pulse beam radiated 
from the light emitting element (LD) 14a, which corresponds 
5 to the data pulse sequence, is shown at the bottom of Fig. 
27 . The sequence of the pulse beam is the same as At delayed 
sequence of the data pulse delayed from the original sequence , 
so the light emitting element 14a radiates laser pulse beams 
according to the binary number in each data period. 
10 Furthermore , since the pulse beam is used as a distance 

measuring light beam , the width of the digit period corresponds 

PU to the width of the distance measuring light beam, the pulse 

fey 

^ width Ts . In the present embodiment, distance information 

a 

sensing operation is carried out by detecting the fall of 

p-j = 

15 the reflected light beam during the accumulating period in 
2t the photo-diodes 51, Therefore, each accumulating period 

in the photo-diodes 51 should be adjusted to each fall of 
the pulse beam. Namely, the CCD driving pulse converter 51 
needs to convert the standard CCD driving pulse, which is 

20 generated in the D mode CCD driving pulse generator 23, to 
a CCD driving pulse adjusted to the fall of the pulse beam. 

The standard CCD driving pulse, which is generated 
in the D mode CCD driving pulse generator 23, is a regular 
pulse , and it comprises a standard electric charge discharging 

25 pulse and a standard electric charge transfer pulse. The 
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standard electric charge discharging pulse is a pulse that 
leads an electric charge discharging operation, and the 
standard electric charge transfer pulse is a pulse that leads 
an electric charge transfer operation. 
5 The CCD driving pulse converter 51 is comprised of 

the data synchronizing pulse generator 50 and the AND circuits 
48 and 49. The data pulse signal that is input to the CCD 
driving pulse converter 51 is firstly converted to the data 
synchronizing pulse at the data synchronizing pulse generator 
^ 10 50. Then the data synchronizing pulse is output to the AND 
pu circuit 48 and 49. At the AND circuit 49, a conjunction of 

PU the data synchronizing pulse and the standard electric charge 

y discharging pulse , which is output from the D mode CCD driving 

pulse generator 23 is carried out and the resultant pulse 
^ 15 is output to the v/D switch 22 as an electric charge discharging 
pulse (electric charge discharging signal) . On the other 
hand, at the AND circuit 48, a conjunction of the data 
synchronizing pulse and the standard electric charge transfer 
pulse, which is output from the D mode CCD driving pulse 
20 generator 23 is carried out and the resultant pulse is also 
output to the V/D switch 22 as an electric charge transfer 
pulse (electric charge transfer signal) . 

The electric charge discharging pulse and electric 
charge transfer pulse , which are CCD drivingpulses , are output 
25 to the CCD drive circuit 30 through the^^^Dyv^ switch 22, and 
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control the electric charge discharging operation and the 
electric charge transfer operation at the photo-diodes 51 
in CCD 23, respectively. 

As described with reference to Fig. 24, the signal 
5 charge accumulating operation at the photo-diodes 51 is 
executed during the accumulating period Tm , which corresponds 
to a pulse width of the pulse S9' , which rises approximately 
simultaneously with the fall of the electric charge 
discharging signal SI. Therefore, when a sequence of the 
yg 10 data pulse is just as the sequence described in Fig. 27, the 

py standard electric charge discharging pulse and the standard 

CO 

PU electric charge transfer pulse are converted to the electric 

W charge discharging pulse and the electric charge transfer 

^ pulse described in Fig . 27, respectively. Consequently, the 

15 signal charge accumulations at the photo-diodes 51 are 

f 

performed at the timing described in the sequence of Fig. 
2 7,, which is the second sequence from the bottom. By this, 
the signal charge accumulating operation at the photo-diodes 
51 is adjusted to the fall of the pulse beam radiated from 

20 the light emitting device 14. 

As described above, the pulse beams of the light 
emitting element 14a are radiated according to the data pulse 
signal corresponding to the transmitting data, so that the 
radiated pulse beam is used as a data transmitting light beam. 

25 At the same time, since the signal charge accumulating 
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operat:xon is adjusted at the fall of the pulse beam, the pulse 
beam is used as a distance measuring light beam. Thus, the 
data transmitting light beam and the distance measuring light 
beam are superposed with each other. 

With reference to Fig. 26 to Fig. 29, the description 
of the light amount supplement operation in the present 
embodiment is given . 

As described in Fig. 21, transmitting data in each 

data period may be different from one another , thus the number 

of the falls in each data period may also be different in 

each data period. Moreover, since the signal charge 

accumulation for the distance measurement is synchronously 

carried out with the fall of the pulse beam, the number of 

signal charge accumulations depends on the transmitting data 

in each data period. For example, in Fig. 27, the numbers 

of signal charge accumulations in each data period are, four 

in the first data period, two in the second and -o^i^^ in the 

A 

third, in which the ordinal is from the left. Therefore, 
the number of signal accumulations in a distance information 
sensing operation depends on the transmitting data, and as 
a result, the accuracy of the distance measurement is 
deteriorated, since the output SMio / a total amount of the 
signal charge, depends on the transmitting data. 

In the present embodiment , the light amount supplement 
operation is carried out and the number of the signal charge 



accumulation or the Integration executed In a distance 
Information sensing operation is fixed to a predetermined 
number, so that the output SMio is independent of the 
transmitting data. Fig. 28 shows the sequence of the light 
emitting operation executed in the distance information 
sensing operation, which is accompanied by the light amount 
supplement operation . 

A distance measuring period or one field period, in 
which the light emitting operation for the distance 
information sensing operation is performed, comprises a data 
transmitting period and a supplement light emitting period. 
In the data transmitting period, the light emitting device 
14 radiates pulse beams for the transmitting data signals, 
and in the supplement light emitting period, the above light 
amount supplement operation, which radiates light beams so 
as to compensate the number of the integrating operation or 
the signal charge accumulating operation, is carried out. 
The number of the data pulses output from the data pulse 
generating circuit 29 is counted in the counter 39, so the 
number of the accumulations or the integrations during the 
data transmitting period is obtained at the end of the data 
transmitting period. From the number of the accumulations 
counted in the data transmitting period, the remaining number 
of the accumulations for the distance information sensing 
operation is calculated, and the radiation of the light beams 



and the corresponding accumulations are carried out In the 
supplement light emitting period for the remaining number 
of times. For example. If the predetermined number of the 
accumulations executed In the distance Information sensing 
operation Is six hundred thousand and the number of 
accumulations executed In the data transmitting period Is 
three hundred thousand, the number of beam pulse radiations 
or the corresponding signal charge accumulations, which Is 
executed In the supplement light emitting period, becomes 
three hundred thousand. Further, If the number of the 
accumulations executed In the data transmitting period Is 
four hundred thousand, the number of beam pulse radiations 
or the signal charge accumulations, which Is executed In the 
supplement light emitting period, becomes two hundred 
thousand . Note that there may be provided a switching period, 
during which the operation switches, between the data 
transmitting period and the supplement light emitting period . 

With reference to Fig. 29, the sequence of the pulse 
beam emission and the signal charge accumulation In the 
supplement light emitting period Is explained In the following . 
Fig. 2 9 shows the sequence of the light amount supplement 
operation performed In the supplement light emitting period. 

In the system control circuit 35 , the remaining number 
of the pulse beam radiations or the signal charge accumulations 
In the supplement light emitting period, which are required 



for executing the predetermined number of integrations, is 
calculated and the dummy data is generated for the light amount 
supplement operation . The generated dummy pulse is output 
through the data pulse generating circuit 29 as a data pulse. 
The sequence of the data pulses is partitioned with the 
partition signals S61 for each 8 bits, as well as the sequence 
of the data pulses representing the transmitting data, which 
is described with reference to Fig. 27. Further, the width 
of the digit period and etc. are similar to those in Fig. 
27. The conversions, which are performed to the data pulse 
of the transmitting data at the delay circuit 45 and the CCD 
driving pulse converter 51, are also performed to the data 
pulse of the dummy data, and converted pulses are output to 
the light emitting control circuit 44 and the CCD drive circuit 
30 as an LD driving pulse and a CCD driving pulse , respectively . 
Namely, when the sequence of the data pulse for the dummy 
data is as described in Fig. 29, the sequences of the electric 
charge discharging pulse and the electric charge transfer 
pulse are reduced to the sequences shown in Fig. 29. 
Consequently, the sequence of the electric charge 
accumulating operation in the photo-diodes also becomes as 
is shown in Fig. 29. Further, a timing for radiating the 
beam pulse is delayed At from that of the data pulse of the 
dummy data . 

Each of the digit periods is adjacent to one another. 
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'bhere£oref if pulses consecutively exist over a certain 
successive digit periods, they compose a single consecutive 
pulse. For example, the above case is shown in Fig. 27 as 
the pulse corresponding to the upper three digits of the third 
5 data period, the single pulse S64 of which a pulse width is 
3 * Ts . Further, as described above, in order to sense the 
distance information, the distance information sensing 
operation needs to detect the fall of the pulse beam during 
the signal charge accumulating period. So, when the digit 
10 of data pulse is 8 bits, the maximum number of the signal 

m 

m charge accumulation for one supplement period is four, which 

Ml is obtained when data pulses exist in alternate digit periods 

CO 

bi of a supplement period. The sequence of data pulse in Fig. 

s 

^^ 29 illustrates the case when the accumulations are required 

^ 3 

l}£ 15 ten times in the supplement light emitting period. In the 
first and second supplement periods, the pulse beams are 
emitted alternately four times, the maximum number of times, 
and corresponding signal charges of reflected pulse beams 
are accumulated respectively . In the third supplement period, 
20 the remaining two times emission and accumulation is carried 
out . 

Note that, the receiving operation of the optical 
transmission system executed in the computer system 4 6 of 
the fourth embodiment is the same as the operation described 
25 in the second and third embodiment, the operation of which 
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Is described wx^h reference -to Fig. 21. 

As described above , "the same advan-tages as 'the second 
and third embodlmen-ts are obtained by ^he fourth eznbodlmen^ . 

Although the exobodlmen ts of t:he present: Invention have 
been described herein with reference to the accompanying 
drawings, obviously many modifications and changes may be 
made by those skilled In this art without departing from the 
scope of the Invention. 

The present disclosure relates to subject matter 
contained In Japanese Patent Application Nos . 11-216449, 
11-216987 and 11-217061 (all filed on July 30, 1999) which 
are expressly Incorporated herein, by reference. In their 
entireties . 



